Information processing apparatus, information processing method, and storage medium

ABSTRACT

An information processing apparatus includes an acquisition unit that acquires a number of objects lining up in a queue when a target object targeted for measuring a queuing time enters the queue, a first detection unit that detects an object exiting the queue, and a measurement unit that measures, as a queuing time of the target object in the queue, a period from a time when the target object enters the queue to a time when a number of objects corresponding to the number acquired by the acquisition unit are detected by the first detection unit after the target object enters the queue.

BACKGROUND Field

Aspects of the present disclosure generally relate to an informationprocessing apparatus, an information processing method, and a storagemedium.

Description of the Related Art

With respect to a queue, such as a queue including persons waiting toget a taxi, where the service time is not constant, there is a need toknow a queuing time of each object or its statistics in the queue.

A conventional system calculates a queuing time based on an averageservice time, e.g., how fast a line is moving and the number of objectsin a queue. Another conventional system issues a numbered ticket when anobject enters a queue and calculates an actual queuing time based on abooking time (the time when the object enters the queue) and guidingtime (the time when the object exits the queue).

For example, Japanese Patent No. 3,826,956 discusses a queuing timemanagement system that measures an actual performance queuing time basedon inputting of waiting start information and waiting end information ina queue via an input unit in, for example, restaurants, play facilities,or banks.

Japanese Patent Application Laid-Open No. 2014-215917 discusses a queueestimation system that provides, at every specified time, an averagequeuing time and the length of a queue required for using an externalterminal based on logs of a service provided by the external terminalwithout separately acquiring the time when a customer stands at the endof the queue.

The conventional technique discussed in Japanese Patent No. 3,826,956can be used to acquire an individual actual performance queuing time.The conventional technique discussed in Japanese Patent ApplicationLaid-Open No. 2014-215917 can be used to calculate an average queuingtime based on logs of a service.

However, Japanese Patent No. 3,826,956 and Japanese Patent ApplicationLaid-Open No. 2014-215917 presume that, for example, when an objectenters a queue, a customer or staff operates a terminal of the system torecord its time.

In the conventional techniques discussed in Japanese Patent No.3,826,956 and Japanese Patent Application Laid-Open No. 2014-215917, inthe case of, for example, a queue for getting a taxi, an input operationon an input device can be troublesome. A queuing time can be calculatedby acquiring an image at the entrance of a queue area, such as anadmission gate or a riding entrance, recognizing an object by, forexample, face authentication, and identifying the object. However, sinceit is necessary to acquire an image of an object with relatively greataccuracy, recognition can fail depending on the orientation of theobject. As a result, for example, a queuing time of the object in aqueue may not be able to be measured. While it can be considered todetect and track an object using image processing, in the case ofperforming tracking in a seamless manner or using a plurality of camerasfor a wide area, there is an issue with the accuracy of tracking, sothat a queuing time can sometimes be unmeasurable.

SUMMARY

According to an aspect of the present disclosure, an informationprocessing apparatus includes an acquisition unit configured to acquirea number of objects lining up in a queue when a target object targetedfor measuring a queuing time enters the queue, a first detection unitconfigured to detect an object exiting the queue, and a measurement unitconfigured to measure, as a queuing time of the target object in thequeue, a period from a time when the target object enters the queue to atime when a number of objects corresponding to the number acquired bythe acquisition unit are detected by the first detection unit after thetarget object enters the queue.

Further features will become apparent from the following description ofexemplary embodiments with reference to the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B respectively illustrate an example of a hardwareconfiguration and an example of a functional configuration of aninformation processing apparatus and other devices or units.

FIG. 2 is a flowchart illustrating an example of processing performed bythe information processing apparatus.

FIGS. 3A and 3B illustrate an example of the application of a queuingtime measurement system.

FIGS. 4A and 4B illustrate an example of a method for calculating aqueuing time.

FIG. 5 illustrates an example of a system configuration of a queuingtime measurement system and other devices.

FIG. 6 illustrates an example of a functional configuration of aninformation processing apparatus and another apparatus.

FIG. 7 illustrates an example of a method for calculating a queuingtime.

FIGS. 8A, 8B, 8C, 8D, and 8E illustrate an example of the application ofthe queuing time measurement system.

FIG. 9 illustrates an example of the application of a queuing timemeasurement system.

FIGS. 10A and 10B illustrate an example of a region targeted forcounting objects.

FIG. 11 illustrates an example of a system configuration of the queuingtime measurement system and other devices.

FIG. 12 illustrates an example of timing of processing performed by thequeuing time measurement system.

FIGS. 13A and 13B illustrate an example of processing performed by thequeuing time measurement system.

FIGS. 14A, 14B, and 14C illustrate an example of the application of aqueuing time measurement system.

DESCRIPTION OF THE EMBODIMENTS

Various exemplary embodiments will be described in detail below withreference to the drawings.

In a first exemplary embodiment, processing performed by a queuing timemeasurement system to measure a queuing time in a queue is described.While, in the first exemplary embodiment, objects lining up in a queueare assumed to be human bodies, they can be, for example, animals suchas farm animals, industrial products or interim products that are beingconveyed via lanes in a factory, cargos or containers that are beingconveyed via transportation lanes.

The queuing time measurement system includes an information processingapparatus 100. The information processing apparatus 100 is aninformation processing apparatus that measures a queuing time in aqueue. The information processing apparatus 100 is configured with, forexample, a personal computer (PC), a server apparatus, or a tabletapparatus.

FIG. 1A illustrates an example of a hardware configuration of theinformation processing apparatus 100 and other devices according to thefirst exemplary embodiment.

The information processing apparatus 100 includes a memory 110, acentral processing unit (CPU) 111, a communication control unit 112, aninput control unit 113, and a display control unit 114.

The memory 110 is a storage device that stores, for example, variousprograms, various pieces of setting data, various pieces of thresholddata, and image data representing captured images of a queue. The CPU111 is a processor that controls processing performed by the informationprocessing apparatus 100. The communication control unit 112 is acommunication controller used to communicate with an external apparatusvia a network. The input control unit 113 is an input controller thatcontrols inputting of information to the information processingapparatus 100 via an input device 120. The display control unit 114 is adisplay controller that controls displaying of a screen on a displaydevice 130. While, in the first exemplary embodiment, the informationprocessing apparatus 100 and the display device 130 are assumed to beseparate devices, the display device 130 can and the informationprocessing apparatus 100 can be integrated into single entity. Thequeuing time measurement system can include a plurality of displaydevices as the display device 130.

For example, functions of the information processing apparatus 100described below with reference to FIG. 1B and processing performed in aflowchart described below with reference to FIG. 2 are implemented bythe CPU 111 executing processing based on a program stored in, forexample, the memory 110.

FIG. 1B illustrates an example of a functional configuration of theinformation processing apparatus 100 and other units according to thefirst exemplary embodiment.

The information processing apparatus 100 includes a counting unit 103, astatus storage unit 104, a setting unit 105, a queuing time calculationunit 106, a communication unit 107, and a display unit 108.

A first passage detection unit 101 and a second passage detection unit102 detect passage of an object included in a queue. Each of the firstpassage detection unit 101 and the second passage detection unit 102 isconfigured with, for example, a passage sensor using, for example,infrared light or a camera including an image analysis function ofdetecting passage of an object. The first passage detection unit 101 isprovided at an entrance of the queue and detects an object entering thequeue. The second passage detection unit 102 is provided at an exit ofthe queue and detects an object exiting the queue. While, in the firstexemplary embodiment, the first passage detection unit 101 and thesecond passage detection unit 102 are configured to detect personspassing through the entrance and exit of the queue on a person-by-personbasis, they can be configured to detect a plurality of persons at atime.

A partial queue that is clipped out of a certain queue can also bedeemed to be a single queue. For example, the queuing time measurementsystem can also deem a line from just the middle position to the exit ina queue standing in a row to be a single queue and measure a queuingtime from the middle position to the exit.

In the first exemplary embodiment, the first passage detection unit 101and the second passage detection unit 102 respectively detect an objectentering a queue and an object exiting a queue and then transmitinformation indicating that the objects have been detected to thecounting unit 103 and the status storage unit 104. However, the queuingtime measurement system can be configured not to include the firstpassage detection unit 101 and the second passage detection unit 102 butto include an imaging apparatus, such as a camera, which captures imagesof the entrance and exit of a queue. In that case, the CPU 111 isconfigured to detect an object entering a queue and an object exiting aqueue based on the images of the entrance and exit of the queue capturedby the imaging apparatus. Furthermore, each of the first passagedetection unit 101 and the second passage detection unit 102 is able tochange an object to be detected, for example, according to aninstruction from the information processing apparatus 100 which is basedon an operation performed by the user via the input device 120.

The counting unit 103 acquires the number of objects present in a queuebased on a result of detection of the passage of objects through theentrance and exit of the queue performed by the first passage detectionunit 101 and the second passage detection unit 102.

When an object passing through the entrance of the queue has beendetected by the first passage detection unit 101, the status storageunit 104 stores information indicating a set of the time of detection ofthe object and the number of objects acquired by the counting unit 103in, for example, the memory 110. The stored time serves as themeasurement start time of a queuing time of the associated object.Moreover, the stored number of objects serves as a waiting order in aqueue of an object entering the queue at the time of detection (thenumber of objects in the queue). Each time an object passing through theentrance of a queue is detected by the first passage detection unit 101,the status storage unit 104 stores information indicating a set of thetime of detection of the object and the number of objects acquired bythe counting unit 103. However, the status storage unit 104 can beconfigured to store information indicating a set of the time detected bythe first passage detection unit 101 and the number of objects countedby the counting unit 103 with respect to the latest object entering aqueue for each set unit time. Moreover, the status storage unit 104 canbe configured to delete data which has become unnecessary for queuingtime measurement from, for example, the memory 110.

The setting unit 105 receives designation of timing of measurement ordisplaying of the number of waiting persons or the queuing time at thetime when the queuing time measurement system is activated, based on anoperation performed by the user via the input device 120. Moreover, thesetting unit 105 determines information indicated by the receiveddesignation as setting information which is information used for queuingtime acquisition processing. The setting unit 105 can store the acquiredinformation in, for example, the memory 110. In a case where the settinginformation previously stored is present in the memory 110, the settingunit 105 can use the stored setting information without receivingdesignation from the user. This eliminates the need for the user toperform an input operation each time the queuing time measurement systemis activated, so that the queuing time measurement system can improveuser convenience.

Each time an object exiting a queue is detected by the second passagedetection unit 102, the queuing time calculation unit 106 decrements thenumber of objects corresponding to the information indicating a setstored by the status storage unit 104 in, for example, the memory 110 asmuch as the number of detected objects. The queuing time calculationunit 106 performs this processing to move up the waiting order in aqueue of an object entering the queue at a certain time.

The queuing time calculation unit 106 sequentially performs thisprocessing each time an object is detected by the second passagedetection unit 102. Then, the queuing time calculation unit 106determines the time when the number of objects corresponding to theinformation indicating a set stored in, for example, the memory 110 bythe status storage unit 104 has become 0 or less as the measurement endtime of a queuing time when an object exits the queue. Then, the queuingtime calculation unit 106 calculates a difference between themeasurement end time and the measurement start time corresponding to theinformation indicating a set stored by the status storage unit 104 as anactual queuing time.

The communication unit 107 transmits information about the queuing timecalculated by the queuing time calculation unit 106 to an externalapparatus such as a terminal device. The communication unit 107 performswired or wireless communications with an external apparatus such as aterminal device.

The display unit 108 displays, on the display device 130, information(for example, a character string or a numerical sequence) indicating thequeuing time calculated by the queuing time calculation unit 106 attiming indicated by the setting information determined by the settingunit 105.

In the first exemplary embodiment, each of the functional constituentelements 103 to 108 is assumed to be a functional constituent elementincluded in the information processing apparatus 100, which is a singleapparatus. However, in a system having a plurality of informationprocessing apparatuses interconnected, the plurality of informationprocessing apparatuses can include the respective functional constituentelements 103 to 108 in a distributed manner. Moreover, each of thefunctional constituent elements 103 to 108 can be configured as hardwareincluded in the information processing apparatus 100.

FIG. 2 is a flowchart illustrating an example of processing performed bythe information processing apparatus 100 according to the firstexemplary embodiment.

The processing illustrated in FIG. 2 is started at the time when thequeuing time measurement system is activated.

In step S201, the setting unit 105 acquires setting information which isused for queuing time measurement processing, based on an operationperformed by the user via the input device 120 or by acquiring settinginformation stored in the memory 110. The counting unit 103 initializesthe number of objects in a queue with the number of objects in a queueobtained at the time when the queuing time measurement system isactivated, which is indicated by the acquired setting information.

In step S202, the first passage detection unit 101 and the secondpassage detection unit 102 detect passage of the respective objectsbased on signals output from the respective passage sensors included inthe first passage detection unit 101 and the second passage detectionunit 102. The first passage detection unit 101 is located in thevicinity of the entrance of a queue and detects an object entering thequeue. The second passage detection unit 102 is located in the vicinityof the exit of a queue and detects an object exiting the queue.

In step S203, the counting unit 103 acquires the number of objectspresent in the queue based on results of detection by the first passagedetection unit 101 and the second passage detection unit 102.

In step S204, when an object has been detected by the first passagedetection unit 101, the status storage unit 104 acquires the number ofobjects present in the queue acquired by the counting unit 103 when theobject has been detected by the first passage detection unit 101. Then,the status storage unit 104 stores information indicating a set of thetime when the object has been detected by the first passage detectionunit 101 and the acquired number of objects in, for example, the memory110.

In step S205, the queuing time calculation unit 106 calculates a queuingtime of an object in the queue according to the setting informationacquired in step S201. Each time an object is detected by the secondpassage detection unit 102, the queuing time calculation unit 106subtracts the number of detected objects from the number of objectscorresponding to the information indicating a set stored in step S204.When the result of subtraction has become 0 or less, the queuing timecalculation unit 106 calculates a difference between the time when anobject has been detected by the second passage detection unit 102 atthat time and the time when the object has been detected by the firstpassage detection unit 101 as a queuing time of the object. The queuingtime calculation unit 106 can process the queuing time calculated asdescribed above into a required display format, such as data used at thetime of start of measurement or at the time of end of measurement, ahistogram in a given time period, or an average value or moving averagevalue at each time.

In step S206, the display unit 108 displays information indicating thequeuing time calculated in step S205 on the display device 130.Furthermore, the display unit 108 can display information about, forexample, a previous queuing time or the frequency of passage of objectsat the entrance or exit in a queue on the display device 130.

In step S207, the communication unit 107 determines whether to transmitinformation about the queuing time calculated in step S205 to anexternal terminal device, for example, based on setting informationstored in the memory 110 or a request from the external terminal device.Then, when determining to transmit information about the queuing timecalculated in step S205 to an external terminal device, thecommunication unit 107 transmits the information about the queuing timecalculated in step S205 to the external terminal device.

In step S208, the queuing time calculation unit 106 determines whetheran instruction for terminating acquisition processing for the queuingtime in a queue has been received based on, for example, an operationperformed by the user via the input device 120. If the queuing timecalculation unit 106 determines that an instruction for terminatingacquisition processing for the queuing time in a queue has been receivedbased on, for example, an operation performed by the user via the inputdevice 120 (YES in step S208), the processing illustrated in FIG. 2ends. If the queuing time calculation unit 106 determines that aninstruction for terminating acquisition processing for the queuing timein a queue is not received based on, for example, an operation performedby the user via the input device 120 (NO in step S208), the processingreturns to step S202.

In the description of FIG. 2, steps S203, S204, S206, and S207 have beendescribed as a series of processing operations. However, the countingunit 103 and the queuing time calculation unit 106 can be configured towrite, for example, results of calculation in steps S203, S204, and S205in, for example, a database or file stored in the memory 110. Then, thequeuing time calculation unit 106, the display unit 108, and thecommunication unit 107 can perform processing for reading contents of,for example, a database or file stored in the memory 110 as processingdifferent from the processing in steps S203 to S205 and in parallel withthe processing in steps S203 to S205. The queuing time measurementsystem and an external terminal device can be interconnected via anetwork, the external terminal device can request the communication unit107 to transmit, for example, data about the queuing time, and datatransmitted from the communication unit 107 in response to the requestcan be displayed on, for example, a display device of the terminaldevice.

Next, an example of an operation of the queuing time measurement systemwhen the processing illustrated in the flowchart of FIG. 2 is performedis described. In an example illustrated in FIGS. 3A and 3B, each of thefirst passage detection unit 101 and the second passage detection unit102 is configured with an infrared sensor.

FIGS. 3A and 3B illustrate an example of the application of the queuingtime measurement system. An example in which processing performed by thequeuing time measurement system is applied to a queue at a taxi stand isdescribed with reference to FIGS. 3A and 3B.

FIG. 3A illustrates a taxi 301 arriving at a taxi stand within a rangeindicated by a region 3001. A region 3002 is a region in which personswho want to take a taxi line up. In the example illustrated in FIGS. 3Aand 3B, a line including all of the persons present in the region 3002is assumed to be a queue.

Within a range of the region 3002, there is an exit 302, which is aplace where to get a taxi, and an entrance 303, which is a place whereto enter the region 3002. Guide poles 304 are guide poles that definethe region 3002 and prompt lining-up of a queue. Instead of the guidepoles 304, for example, a line that clearly indicates a portion where toenter the region 3002 or the route of a queue can be drawn on the floor.

An infrared sensor 305, which serves as the second passage detectionunit 102, is placed above the exit 302. Moreover, an infrared sensor306, which serves as the first passage detection unit 101, is placedabove the entrance 303. Furthermore, a display monitor 307 fordisplaying the calculated queuing time, which serves as the displaydevice 130, is placed in the vicinity of the entrance 303.

The example illustrated in FIG. 3A indicates a state in which any queuehas not yet occurred, and no person is present in the region 3002.

In the state illustrated in FIG. 3A, since a queue for taxis is not yetformed, the number of waiting persons in counting for a queue in stepS203 of the processing flow described with reference to the flowchart ofFIG. 2 is 0.

FIG. 3B illustrates an example of the situation in which a person A whointends to take a taxi is passing under the first passage detection unit101 to enter the region 3002. In the example illustrated in FIG. 3B, thequeuing time measurement system measures a queuing time of the person A.The person A is an example of a target object which is an objecttargeted for queuing time measurement processing performed by thequeuing time measurement system.

FIGS. 4A and 4B illustrate an example of a method of calculating aqueuing time. FIG. 4A illustrates an example of, for example,information stored in, for example, the memory 110 by the status storageunit 104 when the person A has entered the region 3002 in the stateillustrated in FIG. 3B and has entered the queue. In a table illustratedin FIG. 4A, a row indicated by “ARRIVAL OF PERSON A” includesinformation of “11:01:15” (one minute and fifteen seconds past eleven),which is the time when the first passage detection unit 101 detected theperson A (the measurement start time of a queuing time of the person A).Moreover, the row indicated by “ARRIVAL OF PERSON A” in the tableillustrated in FIG. 4A includes information of “9”, which is the numberof persons in the queue counted by the counting unit 103 when the personA got in the queue (the waiting order of the person A in the queue).

Each of the other rows in the table illustrated in FIG. 4A indicates,with respect to a person who got in the queue prior to the person A, thetime when the first passage detection unit 101 detected the person andthe number of persons in the queue counted by the counting unit 103 whenthe person got in the queue. For example, a row just below the rowindicated by “ARRIVAL OF PERSON A” indicates that a certain person gotin the queue at one minute and twenty-eight seconds past eleven and tenpersons including the certain person were present in the queue when thecertain person got in the queue.

FIG. 4B illustrates an example of a table indicating the time when aperson passing through the exit of the queue (a person exiting thequeue) was detected by the second passage detection unit 102.

The queuing time calculation unit 106 performs the following processingeach time the second passage detection unit 102 detects a person exitingthe queue after the time when the first passage detection unit 101detected the person A. In other words, the queuing time calculation unit106 subtracts the number of persons detected by the second passagedetection unit 102 one by one from the number of persons in the queuepresent when the person A got in the queue stored in the status storageunit 104.

The table illustrated in FIG. 4A stored by the status storage unit 104can further include, besides the entry detection time and the number ofpersons in a queue, an item of “waiting order”. Then, in a case where aperson is detected by the first passage detection unit 101, when addinga new row to the table illustrated in FIG. 4A, the status storage unit104 enters the same value as that of the item of the number of personsin a queue into an item of the waiting order. Each time a person isdetected by the second passage detection unit 102, the queuing timecalculation unit 106 subtracts the number of persons detected by thesecond passage detection unit 102 from the number of the waiting orderin the table illustrated in FIG. 4A. Then, when the value of the waitingorder of the person A has become 0 or less, the queuing time calculationunit 106 determines that the person A has exited the queue. Numerals atthe side of the table illustrated in FIG. 4B indicate the values of thewaiting order of the person A. The example illustrated in FIG. 4Bindicates that, each time a person exiting the queue is detected by thesecond passage detection unit 102, the value is decremented by one. Inthe example illustrated in FIG. 4B, it is revealed that the person A gotout of the queue at six minutes and twenty seconds past eleven, when thevalue of the waiting order became 0.

Accordingly, the queuing time calculation unit 106 calculates thequeuing time of the person A as “six minutes and twenty seconds pasteleven”−“one minute and fifteen seconds past eleven”=“five minutes andfive seconds”.

In the description of the first exemplary embodiment, information aboutthe waiting order of a person in a queue is stored by the status storageunit 104 in the table illustrated in FIG. 4A. However, the statusstorage unit 104 can be configured to store information about thewaiting order of a person entering a queue in, for example, the memory110 as information separate from the table illustrated in FIG. 4A. Inthat case, the queuing time calculation unit 106 decrements the valuestored in the information about the waiting order stored as informationseparate from the table illustrated in FIG. 4A each time a person isdetected by the second passage detection unit 102.

In a case where it is unnecessary to preserve information about thenumber of persons in a queue when a person enters the queue, the statusstorage unit 104 can be configured not to store information about thewaiting order of a person in the queue. In that case, the queuing timecalculation unit 106 decrements the value stored in the item of thenumber of persons in a queue in the table illustrated in FIG. 4A eachtime a person is detected by the second passage detection unit 102.Then, the queuing time calculation unit 106 determines that the timewhen the second passage detection unit 102 has detected a person in acase where the value stored in the item of the number of persons in aqueue in the table illustrated in FIG. 4A has become 0 or less is thetime when a person corresponding to the number of persons in a queuehaving become 0 or less has exited the queue.

In the description of the first exemplary embodiment, the queuing timecalculation unit 106 sequentially decrements the waiting order of acertain person in a queue each time a person exits the queue, asmentioned above, thus acquiring the time when the certain person exitsthe queue and calculating the queuing time of the certain person in thequeue. However, the queuing time calculation unit 106 can be configuredto perform the following processing.

For example, the status storage unit 104 stores information indicatingthe table illustrated in FIG. 4A or FIG. 4B in a database implemented inthe memory 110. The queuing time calculation unit 106 makes thefollowing inquiry to the database using Structured Query Language (SQL).Specifically, the queuing time calculation unit 106 makes an inquiry insuch a way as to ask the database to acquire the time of an ordercorresponding to the number of persons in a queue when a certain persongot in the queue from among the times when persons exiting the queuewere detected stored after the time when the certain person got in thequeue, based on the table illustrated in FIG. 4B. Then, the queuing timecalculation unit 106 determines that the time acquired as a result ofthe inquiry is the time when the certain person got out of the queue.

The queuing time calculation unit 106 can compare a predicted value ofthe queuing time of an object previously stored in, for example, thememory 110 with the actually measured queuing time of an object andoutput and store information indicating a result of the comparison tothe memory 110. The information indicating a result of the comparisonis, for example, information about a difference between the queuingtimes or information indicating whether the queuing times are the same.Furthermore, the communication unit 107 can output and transmitinformation indicating a result of the comparison made by the queuingtime calculation unit 106 to another apparatus. Moreover, the displayunit 108 can output and display information indicating a result of thecomparison made by the queuing time calculation unit 106 on the displaydevice 130. With this, the queuing time measurement system can present aresult of comparison between the predicted value and the actualmeasurement result to the user.

As described above, in the first exemplary embodiment, the queuing timemeasurement system detects each object exiting a queue. Then, thequeuing time measurement system detects that, from when a certain objectenters the queue, a number of objects corresponding to the number ofobjects present in the queue when the certain objects enter the queueexit the queue. Then, the queuing time measurement system determinesthat the detected time is the time when the certain object got out ofthe queue and measures a queuing time of the certain object based on thetime when the certain object got out of the queue and the time when thecertain object got in the queue.

In this way, the queuing time measurement system determines whether acertain object has exited a queue based on the number of objects presentin the queue when the certain object starts standing in the queue andthe number of objects which have exited the queue. With the aboveprocessing, without performing processing, such as image recognition ortracking, on a certain object which has entered a queue, the queuingtime measurement system can determine whether the certain object hasexited the queue. With this, the queuing time measurement system canmeasure a queuing time without causing an object which has entered aqueue to perform an input operation on, for example, a reception device.Therefore, the queuing time measurement system can reduce a troublesomeoperation as compared with a case where, for example, an input operationis performed on, for example, a reception device, and can more readilymeasure a queuing time of an object in a queue. Furthermore, the queuingtime measurement system does not perform processing, such as imagerecognition or tracking, on a certain object which has entered a queue,and is, therefore, unlikely to lose sight of the object due to, forexample, failure of recognition or tracking. Thus, the queuing timemeasurement system can more stably measure a queuing time in a queue.

Furthermore, since the first passage detection unit 101 and the secondpassage detection unit 102 respectively detect passage of a person atthe entrance and exit of a queue, it is unnecessary to individuallyacquire information about a person who enters and exits the queue attiming of entry and exit in the queue.

In the first exemplary embodiment, the queuing time measurement systemmeasures a queuing time in a queue for waiting to take a taxi as a queuethe service time of which is not constant. However, the queuing timemeasurement system can also measure a queuing time in, for example, aqueue for waiting to enter a restaurant, a queue at the cash register ina shop, or a queue at the counter or security check in an airport as aqueue the service time of which is not constant.

In the above-described first exemplary embodiment, the queuing timemeasurement system detects a human body passing through the entrance andthe exit of a queue using the first passage detection unit 101 and thesecond passage detection unit 102, each of which is an infrared sensor.

In a second exemplary embodiment, a queuing time measurement systemdetects a human body passing through the entrance and the exit of aqueue based on an image of the queue captured by an imaging apparatus501.

FIG. 5 illustrates an example of a system configuration of a queuingtime measurement system and another apparatus according to the secondexemplary embodiment.

The queuing time measurement system according to the second exemplaryembodiment includes an information processing apparatus 100 and animaging apparatus 501. The information processing apparatus 100 and theimaging apparatus 501 are interconnected via a network 520 in such a wayas to be able to communicate with each other. The network 520 is anetwork used to interconnect the imaging apparatus 501 and theinformation processing apparatus 100. The network 520 is configuredwith, for example, a plurality of routers, switches, and cables, whichsatisfy a communication standard, such as Ethernet. In the secondexemplary embodiment, the network 520 does not have restrictions on itscommunication standard, scale, and configuration as long as it iscapable of performing communications between the imaging apparatus 501and the information processing apparatus 100. For example, the network520 can be configured with, for example, the Internet, a wired localarea network (LAN), a wireless LAN, or a wide area network (WAN).

The imaging apparatus 501 is for example, a network camera. In thesecond exemplary embodiment, the information processing apparatus 100performs, for example, driving of the imaging apparatus 501 andacquisition of a captured image from the imaging apparatus 501. Anexample of a hardware configuration of the queuing time measurementsystem is described with reference to FIG. 5.

The hardware configuration of the information processing apparatus 100according to the second exemplary embodiment is similar to that in thefirst exemplary embodiment.

For example, functions of the information processing apparatus 100described below with reference to FIG. 6 and processing performed in theflowchart of FIG. 2 are implemented by the CPU 111 executing processingbased on a program stored in, for example, the memory 110.

The imaging apparatus 501 includes a memory 510, a CPU 511, an imagingunit 512, a signal processing unit 513, a drive control unit 514, and acommunication control unit 515.

The memory 510 is a storage device which stores, for example, variousprograms, various pieces of setting data, various pieces of image datarepresenting captured images of a queue. The CPU 511 is a processorwhich controls processing that is performed by the imaging apparatus501.

The imaging unit 512 includes an image sensor and an optical systemwhich forms a subject image on the image sensor, and performs capturingof an image on the image sensor with an intersection point between theoptical axis of the optical system and the image sensor used as an imagecapturing center. The imaging unit 512 uses an image sensor such as acomplementary metal-oxide semiconductor (CMOS) sensor or acharge-coupled device (CCD) sensor.

The signal processing unit 513 performs signal processing on an imagesignal captured by the imaging unit 512. The signal processing unit 513performs, for example, coding of an image signal captured by the imagingunit 512. The signal processing unit 513 performs, for example, codingof an image signal captured by the imaging unit 512 using a codingmethod such as Joint Photographic Experts Group (JPEG).

Furthermore, the signal processing unit 513 can be configured to performcoding of an image signal captured by the imaging unit 512 using acoding method such as H.264/MPEG-4 AVC (hereinafter referred to as“H.264”). Moreover, the signal processing unit 513 can be configured toperform coding of an image signal captured by the imaging unit 512 usinga coding method such as High Efficiency Video Coding (HEVC).Additionally, the signal processing unit 513 can be configured toperform coding while selecting a coding method from among a plurality ofcoding methods.

The drive control unit 514 performs control to change the imagingdirection and the angle of view of the imaging unit 512. In the secondexemplary embodiment, the imaging unit 512 is able to change the imagingdirection in pan directions and tilt directions and to change theimaging angle of view. The imaging apparatus 501 does not need to have afunction to change the imaging direction in pan directions and tiltdirections, and does not need to have a function to change the angle ofview.

The communication control unit 515 is a communication controller usedfor communications with an external apparatus, such as the informationprocessing apparatus 100, via the network 520. The communication controlunit 515 transmits information representing a captured image processedby the signal processing unit 513 to the information processingapparatus 100. Moreover, the communication control unit 515 receives acontrol instruction issued to the imaging apparatus 501, which istransmitted from the information processing apparatus 100.

For example, the functions of the imaging apparatus 501 and theprocessing performed by the imaging apparatus 501 are implemented by theCPU 511 executing processing based on a program stored in, for example,the memory 510.

FIG. 6 illustrates an example of a functional configuration of theinformation processing apparatus 100 and another apparatus in the secondexemplary embodiment. The information processing apparatus 100 accordingto the second exemplary embodiment includes an entry detection unit 502,an exit detection unit 503, a counting unit 103, a setting unit 105, aqueuing time calculation unit 106, a communication unit 107, and adisplay unit 108. The information processing apparatus 100 in the secondexemplary embodiment differs from that in the first exemplary embodimentin that the information processing apparatus 100 includes the entrydetection unit 502 and the exit detection unit 503 but does not includethe status storage unit 104. The setting unit 105, the queuing timecalculation unit 106, the communication unit 107, and the display unit108 are similar to those in the first exemplary embodiment.

The entry detection unit 502 and the exit detection unit 503respectively detect entry and exit of objects forming a queue based onan image of the queue captured by the imaging apparatus 501. The imagingapparatus 501 is placed in such a way as to be capable of capturing animage of the entire queue. Each of the entry detection unit 502 and theexit detection unit 503 acquires an image captured by the imagingapparatus 501 as a moving image, and detects passage of an object at aset position based on a temporal change in position of the objectdetected by image processing and analysis of each frame included in themoving image. Each of the entry detection unit 502 and the exitdetection unit 503 is also able to detect passage of an object at eachof a plurality of positions in the image.

The counting unit 103 performs image processing or image analysis todetect objects from an image output from the imaging apparatus 501 andcounts the number of detected objects. In a case where the imagingapparatus 501 would capture an image of an object present in a regionother than a queue, the counting unit 103 can be configured to detectobjects only from a previously set region in the image and to count thenumber of detected objects.

The queuing time calculation unit 106 acquires respective passage timesof an object at the entrance and the exit of a queue from the entrydetection unit 502 and the exit detection unit 503 at timing indicatedby the setting information determined by the setting unit 105, andrecords information indicating the passage times. Moreover, the queuingtime calculation unit 106 acquires the number of objects present in aqueue at timing of detection by the entry detection unit 502 from thecounting unit 103.

Then, at each time (T1) when passage is detected by the entry detectionunit 502, the queuing time calculation unit 106 acquires the time (T2)when a number of objects equal to or greater than the number acquired bythe counting unit 103 have been detected by the exit detection unit 503after the time T1. Then, the queuing time calculation unit 106calculates “T2−T1” as an actual queuing time of an object which got inthe queue at the time T1.

An example of processing performed by the information processingapparatus 100 in the second exemplary embodiment is described withreference to FIG. 2.

The processing in the flowchart of FIG. 2 is started, for example, atthe time when the queuing time measurement system is activated.

Processing in step S201 is similar to that in the first exemplaryembodiment.

In step S202, the entry detection unit 502 and the exit detection unit503 respectively detect an object entering a queue and an object exitingthe queue based on an image acquired from the imaging apparatus 501.

In step S203, the counting unit 103 counts the number of objects in thequeue by analyzing an image captured by the imaging apparatus 501.

In step S204, each time an object is detected by the entry detectionunit 502, the queuing time calculation unit 106 stores the time ofdetection (T1) and the number of persons in the queue acquired by thecounting unit 103 when the detected person enters the queue in, forexample, the memory 110.

In step S205, the queuing time calculation unit 106 stores the number ofobjects detected by the exit detection unit 503, and determines whetherthe number of objects detected after the time stored in step S204 isequal to or greater than the number of objects in the queue acquired instep S204. If it is determined that the number of objects detected afterthe time stored in step S204 is equal to or greater than the number ofobjects in the queue acquired in step S204, the queuing time calculationunit 106 determines that the time when a number of objects equal to orgreater than the number of objects in the queue acquired in step S204have been detected is the time T2. Then, the queuing time calculationunit 106 calculates a queuing time of the object in the queue based onthe time T1 and the time T2. Processing in steps S206 to S208 is similarto that in the first exemplary embodiment.

In the description of FIG. 2, steps S203, S204, S206, and S207 have beendescribed as a series of processing operations. However, the countingunit 103 and the queuing time calculation unit 106 can be configured towrite, for example, results of calculation in steps S203, S204, and S205in, for example, a database or file stored in the memory 110. Then, thequeuing time calculation unit 106, the display unit 108, and thecommunication unit 107 can perform processing for reading contents of,for example, a database or file stored in the memory 110 as processingdifferent from the processing in steps S203 to S205 and in parallel withthe processing in steps S203 to S205.

The queuing time measurement system and an external terminal device canbe interconnected via a network, the external terminal device canrequest the communication unit 107 to transmit, for example, data aboutthe queuing time, and data transmitted from the communication unit 107in response to the request can be displayed on, for example, a displaydevice of the terminal device.

Furthermore, FIG. 7 illustrates an example of queuing time calculationprocessing in the second exemplary embodiment. In the second exemplaryembodiment, the queuing time calculation unit 106 calculates a queuingtime by storing the times when objects are detected by the entrydetection unit 502 and the exit detection unit 503 and the number ofwaiting persons in the database included in the memory 110 and making aninquiry to the database using SQL.

For example, suppose that the number of waiting persons when a person Aarrives (T1=one minute and fifteen seconds past eleven) is 8. Since thetime (T2) of detection of an object when the number of records ofdetection time of objects exiting the queue after one minute and fifteenseconds past eleven becomes 9 is six minutes and twenty seconds pasteleven, the queuing time of the person A becomes five minutes andfifteen seconds. The queuing time calculation unit 106 performs theabove-described processing with respect to a person entering the queueat one minute and twenty-eight seconds past eleven, a person enteringthe queue at two minutes and nineteen seconds past eleven, . . . , insequence.

FIGS. 8A, 8B, 8C, 8D, and 8E illustrate an example of the application ofthe queuing time measurement system.

FIG. 8A illustrates an example of an image of a queue waiting to take ataxi captured by the imaging apparatus 501. The entry detection unit502, the exit detection unit 503, and the counting unit 103 detect humanbodies by detecting upper halves of the human bodies from the imageillustrated in FIG. 8A. Each of detected human body frames 801 is aframe indicating the detected upper half of the human body. The displayunit 108 is able to generate a detected human body frame 801 based onthe center position and size of the detected upper half of the humanbody and to display the detected human body frame 801 in superimpositionon an image captured by the imaging apparatus 501 on, for example, thedisplay device 130.

Each of passage detection line segments 802 and 803 is a line segmentindicating a portion where to detect passage. The passage detection linesegment 802 is a line segment used to detect an object exiting thequeue. Moreover, the passage detection line segment 803 is a linesegment used to detect an object entering the queue. The setting unit105 is able to set the passage detection line segments 802 and 803, forexample, in the following way. Specifically, the setting unit 105instructs the display unit 108 to display, on the display device 130, apassage detection line segment designation screen used to designate thepassage detection line segments 802 and 803 and including an imagecaptured by the imaging apparatus 501. Then, the setting unit 105receives the designation of the passage detection line segments 802 and803 by the user based on an operation performed by the user on thepassage detection line segment designation screen via the input device120. For example, the user designates the passage detection linesegments 802 and 803 by drawing line segments via drag processing usinga mouse at positions where to intend to designate passage detection linesegments on an image captured by the imaging apparatus 501 included inthe passage detection line segment designation screen. The setting unit105 is able to receive such a designation from the user and to determinethe line segments indicated by the received designation as the passagedetection line segments 802 and 803.

In a case where a person detected as a detected human body frame 801Ahas moved forward as illustrated in FIG. 8B so as to take a taxi, instep S202, the exit detection unit 503 tracks the person correspondingto the detected human body frame 801A. The exit detection unit 503recognizes that the person corresponding to the detected human bodyframe 801A in FIG. 8B has passed the passage detection line segment 802from the state illustrated in FIG. 8A. In this way, the exit detectionunit 503 determines whether a certain person has passed the passagedetection line segment 802 based on a change in position of the sameperson in a plurality of serial image frames in a moving image acquiredfrom the imaging apparatus 501.

Furthermore, in step S203, the counting unit 103 counts the number ofhuman bodies, which serve as objects, present in the image illustratedin FIG. 8B.

In the case of counting the number of objects present in an imagecaptured by the imaging apparatus 501 in step S203, the counting unit103 can be configured to detect objects from a set region in the imageand to count the number of detected objects. A region 805 illustrated inFIG. 8C is an example of a region targeted for counting objects, whichis set to distinguish persons standing in the queue from a passerby 804.

The setting unit 105 is able to determine a region targeted for countingobjects, for example, in the following way. Specifically, the settingunit 105 instructs the display unit 108 to display, on the displaydevice 130, a region designation screen used to designate a regiontargeted for counting objects including an image captured by the imagingapparatus 501. Then, the setting unit 105 receives the designation ofthe region targeted for counting objects by the user based on anoperation performed by the user on the region designation screen via theinput device 120. For example, the user designates the region bydesignating points serving as the corners of the region via clickprocessing using a mouse at positions which to intend to designate asthe corners of a region on an image captured by the imaging apparatus501 included in the region designation screen. The setting unit 105 isable to receive such a designation from the user and to determine aregion indicated by the points set by the received designation as theregion 805.

Furthermore, in a case where the passage detection line segments 802 and803 are set as illustrated in FIG. 8D, the counting unit 103 can beconfigured to detect objects from a rectangular region defined by thepassage detection line segments 802 and 803 and then count the detectedobjects.

Moreover, the counting unit 103 can count objects using a combination ofpassage detection line segments and a region targeted for counting whichare previously set.

In the second exemplary embodiment, the queue is a queue formed bypersons waiting for a taxi. Since it can be assumed that a child doesnot take a taxi alone but takes a taxi together with an adult, thequeuing time measurement system can be configured to deem objects in aqueue to be only adults. It can be assumed that a child is shorter inheight than an adult. Therefore, in this case, the setting unit 105 setsthe positions of the region 805 targeted for counting objects and thepassage detection line segment 802 to positions higher than thoseillustrated in FIG. 8C in such a manner that not all of the upper halfof a child is contained in the region 805, as illustrated in FIG. 8E.With this, the entry detection unit 502, the exit detection unit 503,and the counting unit 103 can detect the upper halves of the adult humanbodies without detecting the upper half of a child human body.Furthermore, the counting unit 103 detects a human body by detecting theupper half of the human body, and is, therefore, able to detect a humanbody more accurately than detect the entire human body.

Moreover, it can be assumed that, in a case where the queue is a queueformed by persons standing in line at a children's amusement facility,adults do not use the amusement facility. Therefore, the queuing timemeasurement system can be configured to deem objects in the queue to beonly children. It can be assumed that an adult is taller than a child.Therefore, in this case, the setting unit 105 sets the positions of theregion 805 targeted for counting objects and the passage detection linesegment 802 to positions lower than those illustrated in FIG. 8C in sucha manner that not all of the upper half of an adult is contained in theregion 805. With this, the entry detection unit 502, the exit detectionunit 503, and the counting unit 103 can detect the upper halves of thechild human bodies without detecting the upper half of an adult humanbody.

Additionally, in the second exemplary embodiment, the imaging apparatus501 is placed in such a way as to capture an image of the queue from anoblique direction. With this placement, the imaging apparatus 501 cancapture an image of human bodies in the queue in such a manner that thehuman bodies do not overlap each other. With this, the queuing timemeasurement system can more accurately detect human bodies from theimage.

Each of the entry detection unit 502 and the exit detection unit 503detects passage of an object through the passage detection line segment803 or 802 by detecting the same object at regions on both sides acrossthe passage detection line segment 803 or 802 in an image. For example,in a case where the passage detection line segment 802 is present in thevicinity of the right-hand edge of an image, a region to the right ofthe passage detection line segment 802 becomes too narrow to capture theentire image of an object, so that the exit detection unit 503 becomesunable to detect the object.

Therefore, the setting unit 105 can be configured to determine theposition of each of the passage detection line segments 803 and 802 insuch a manner that the sizes of regions on both sides across the passagedetection line segment 803 or 802 are sizes set to such a degree as toenable detecting an object. For example, the setting unit 105 determinesthe position of each of the passage detection line segments 803 and 802in such a manner that the sizes of regions on both sides across thepassage detection line segment 803 or 802 are larger than the size of anobject to be detected. With this, each of the entry detection unit 502and the exit detection unit 503 can more stably detect an object passingthe passage detection line segment 803 or 802, so that the accuracy ofqueuing time measurement can be improved.

As described above, according to the second exemplary embodiment, thequeuing time measurement system counts the number of persons present ina queue based on an image of the queue acquired from the imagingapparatus 501, thus detecting a person entering the queue and a personexiting the queue. In this way, the queuing time measurement system isable to perform queuing time measurement processing based on a capturedimage of the queue. With this, it becomes unnecessary to individuallyset an apparatus for detecting passage of a person at a set position,such as an infrared sensor, at a predetermined position for a queue.With this, the queuing time measurement system can be configured in sucha way as to simplify the configuration of the queuing time measurementsystem.

Furthermore, the queuing time measurement system only needs to performrecognition and tracking of an object only in the vicinity of theposition where an object enters a queue and the position where an objectexits the queue. Therefore, the queuing time measurement system does notneed to perform recognition and tracking of an object in the entireregion from the position where the object enters a queue to the positionwhere the object exits the queue in an image, and is, therefore, able tomore readily measure a queuing time.

In the description of the second exemplary embodiment, a single imagingapparatus 501 captures an image of the entire queue. In a thirdexemplary embodiment, a region in which a queue is present is broaderthan in the second exemplary embodiment, and a plurality of imagingapparatuses is configured to capture an image of the queue in adivisional manner. Furthermore, in the description of the first andsecond exemplary embodiments, the number of exits of a queue is one. Inthe third exemplary embodiment, a plurality of exits is assumed to bepresent in a queue.

A system configuration of the queuing time measurement system and ahardware configuration and functional configuration of each systemconstituent element in the third exemplary embodiment are similar tothose in the second exemplary embodiment. In the third exemplaryembodiment, the imaging apparatus 501 is configured with a plurality ofimaging apparatuses.

FIG. 9 illustrates an example of the application of the queuing timemeasurement system according to the third exemplary embodiment. Anexample of a queue at a taxi stand, which serves as a target for queuingtime measurement processing, is described with reference to FIG. 9.Points different from those in FIGS. 3A and 3B are described.

Regions 9001 and 9002 are regions where taxis arrive. Taxis arrive atnot a single region but two regions. Taxis 901 and 902 arrive inside theranges of regions 9001 and 9002, respectively.

Furthermore, a region 9003 is a region in which persons waiting for ataxi stand in line. The region 9003 is larger than the region 3002 andincludes two riding entrances (exits of a queue) serving as exits 903and 904 where to take a taxi.

For example, an attendant standing near the exit 904 guides a person 912waiting for a taxi to select whether to wait at the exit 903 or todirectly wait at the exit 904.

In order to capture an image of a queue in a taxi stand such as thatillustrated in FIG. 9, a plurality of cameras 907 to 909 is placed.Furthermore, images captured by the cameras 907 and 908 are used todetect objects passing through the riding entrances (exits of thequeue), as in the second exemplary embodiment. The cameras 907 to 909correspond to an imaging apparatus 501 in the third exemplaryembodiment.

In order for the counting unit 103 to count the number of persons in aqueue at the taxi stand without omission based on images captured by thecameras 907 to 909, the cameras 907 to 909 are arranged in the followingway. Specifically, the cameras 907 to 909 are arranged in such a mannerthat their image capturing regions have respective overlaps. An imagecapturing region 907A illustrated in FIG. 9 is a region indicating animage capturing range provided by the camera 907. An image capturingregion 908A illustrated in FIG. 9 is a region indicating an imagecapturing range provided by the camera 908. An image capturing region909A illustrated in FIG. 9 is a region indicating an image capturingrange provided by the camera 909. FIG. 10A illustrates an example of animage captured by the camera 907. FIG. 10B illustrates an example of animage captured by the camera 908. At this time, since a region 1001 anda region 1002 overlap each other, the setting unit 105 determinesregions 1003 and 1004, which serve as targets for detecting objects, insuch a way as not to redundantly detect objects. The setting unit 105determines the regions 1003 and 1004, for example, using a methodsimilar to the method of determining the region 805 illustrated in FIG.8C in the second exemplary embodiment.

FIG. 11 illustrates an example of a system configuration of the queuingtime measurement system and other devices in the third exemplaryembodiment. FIG. 11 is a block diagram.

The cameras 907 to 909 capture images of a queue lining up in the taxiwaiting region 9003.

Each of the entry detection unit 502 and the exit detection unit 503detects an object passing a set passage detection line segment based onimages captured by the cameras 907 to 909 and then transmits the timewhen the object has passed the passage detection line segment to thequeuing time calculation unit 106. The setting unit 105 determines aline segment designated via a passage detection setting graphical userinterface (GUI) 1106 as the passage detection line segment. The passagedetection setting GUI 1106 is a GUI used to designate a passagedetection line segment. The passage detection line segment designationscreen described in the second exemplary embodiment is an example of thepassage detection setting GUI 1106. In the third exemplary embodiment,the information processing apparatus 100 is assumed to be a stand-aloneinformation processing apparatus. However, in a case where an increasein number of images captured by the cameras 907 to 909 makes itdifficult for a stand-alone information processing apparatus to processall of the captured images within a set period, a plurality ofinformation processing apparatuses can be provided to process therespective images in a distributed manner. In that case, the informationprocessing apparatus 100 is configured with a plurality of informationprocessing apparatuses. Furthermore, the cameras 907 to 909 can beconfigured to have, for example, a function to count the number ofobjects in a set region and a function to detect an object passing a setpassage detection line segment. In that case, the cameras 907 to 909transmit, in addition to captured images, information indicating, forexample, a result of detection of the number of objects in the setregion and an object passing the set passage detection line segment tothe information processing apparatus 100.

Furthermore, the setting unit 105 determines a region designated via anumber-of-persons count setting GUI 1107 to be a region targeted forcounting objects. The number-of-persons count setting GUI 1107 is a GUIused to designate a region targeted for counting objects. The regiondesignation screen described in the second exemplary embodiment is anexample of the number-of-persons count setting GUI 1107.

The counting unit 103 counts, at set timing, the number of objectsincluded in a region determined via the number-of-persons count settingGUI 1107 in images captured by the cameras 907 to 909. The queuing timemeasurement system uses one or a plurality of images captured by thecameras 907 to 909 for processing for counting objects in a queueaccording to the waiting status of the queue.

The counting unit 103 does not necessarily need to perform processingfor counting objects in a queue based on a moving image output from theimaging apparatus 501, but can perform such processing based on a stillimage acquired from the imaging apparatus 501 at set timing.

The counting unit 103 performing processing for counting objects in aqueue after acquiring one still image at set timing can more reduce theload on a resource of, for example, the CPU 111 than performingprocessing for counting objects in a queue while constantly acquiring amoving image. Moreover, the number of cameras capable of performingprocessing for counting the number of persons with a single informationprocessing apparatus increases advantageously.

In that case, as illustrated in FIG. 12, the queuing time measurementsystem can acquire images captured at the same time from the cameras andstart analytical processing, such as processing for counting objects ina queue and processing for detecting passage of an object at the passagedetection line segment, in sequence with respect to the respectiveacquired images. According to this processing, since processing isperformed on the images captured at the same time by a plurality ofcameras, when persons in a queue move, the same person can be preventedfrom being photographed by different cameras and being redundantlycounted. Moreover, the processing load on the CPU 111 can be reduced.

Furthermore, in a case where the counting unit 103 counts the number ofobjects in a queue based on still images captured at regular intervals,the counting unit 103 would count only the number of objects in a queueat the times when still images have been captured. In this case, thecounting unit 103 can count the number of objects in a queue at the timeother than the timing of capturing of still images in the following way.

Specifically, the counting unit 103 acquires, based on an image capturedat a set time, the number of objects in a queue at that time. Then,until a next still image is acquired from the camera after that time,the counting unit 103 adds “1” to the acquired number of objects eachtime an object passing through the entrance of the queue is detected bythe entry detection unit 502. Moreover, until a next still image isacquired from the camera after that time, the counting unit 103subtracts “1” from the acquired number of objects each time an objectpassing through the exit of the queue is detected by the exit detectionunit 503. With this processing, the counting unit 103 corrects thenumber of objects in a queue each time passage of an object at theentrance or exit of the queue is detected, and thus can reduce the loadon the CPU 111 and further can correctly count the number of objects inthe queue.

In the third exemplary embodiment, a plurality of entrances, such as theentrance 903 and the entrance 904, is present in a queue. Therefore,when an object enters a queue, the object in the queue does notnecessarily get out of the queue after all of the objects alreadypresent in the queue get out of the queue. For example, in a case wherean object is present in the region 913 when a certain object exits thequeue through the exit 904, the waiting order of the certain object,which is decremented each time an object exits the queue, does notbecome “0”. Therefore, in the case of the queuing time measurementsystems in the first and second exemplary embodiments, since the waitingorder of the certain object does not become “0”, the fact that thecertain object has exited the queue cannot be recognized.

Accordingly, in the third exemplary embodiment, the queuing timemeasurement system performs, for example, the following processing. Thequeuing time measurement system deems a queue formed by objects presentin a region other than the region 913 in the region 9003 as a firstqueue, and deems a queue formed by objects present in the region 913 asa second queue. The queuing time measurement system deems the exit 904and the entrance of the region 913 as an exit of the first queue. Eachof the first queue and the second queue is an example of a partialqueue, which is a partial queue of the entire queue.

When an object passing through the entrance 906 and entering the firstqueue is detected by the entry detection unit 502, the counting unit 103counts the number of objects present in the first queue when the objectenters the first queue. Then, the counting unit 103 determines thecounted value as a waiting order of the object. Then, the queuing timecalculation unit 106 performs the following processing each time anobject passing through the exit 904 and exiting the first queue or anobject entering the region 913 and exiting the first queue is detectedby the exit detection unit 503. Specifically, the queuing timecalculation unit 106 decreases the waiting order of the object enteringthe first queue by the number of detected objects.

If, when the waiting order of the object entering the first queue hasbecome 0 or less, an object passing through the exit 904 is detected bythe exit detection unit 503, the queuing time calculation unit 106performs the following processing. Specifically, the queuing timecalculation unit 106 determines the time of detection as the time whenthe object entering the first queue has exited the entire queue. Then,the queuing time calculation unit 106 measures a queuing time of theobject based on the time when the object has exited the entire queue andthe time when the object entering the first queue was detected by theentry detection unit 502.

Moreover, if, when the waiting order of the object has become 0 or less,an object exiting the first queue is detected by the exit detection unit503 and an object entering the second queue is detected by the entrydetection unit 502, the queuing time calculation unit 106 performs thefollowing processing. Specifically, the queuing time calculation unit106 determines the time of detection as the time when the objectentering the first queue has exited the first queue. Then, the queuingtime calculation unit 106 measures a queuing time of the object in thefirst queue based on the time when the object has exited the first queueand the time when the object entering the first queue was detected bythe entry detection unit 502. Then, the queuing time measurement systemsimilarly calculates a queuing time in the second queue with respect tothe object entering the second queue.

Then, the queuing time calculation unit 106 adds together the calculatedqueuing time in the first queue and the calculated queuing time in thesecond queue, and calculates a result of the addition as a queuing timeof the object in the entire queue.

The queuing time calculation unit 106 stores information indicating thecalculated queuing time in, for example, a database (DB) 1109 or a commaseparated value (CSV) file stored in the memory 110. Furthermore, thecommunication unit 107 can transmit information indicating the queuingtime calculated by the queuing time calculation unit 106 to an externalterminal device. Moreover, the display unit 108 can display theinformation on, for example, an external monitor 1110. The monitor 1110is a display such as a digital signage device, and is an example of thedisplay device 130. The queuing time calculation unit 106 can store, ina database stored in the memory 110, not only information indicting thecalculated queuing time but also information indicating, for example,the time when an object passed the passage detection line segment andthe number of objects in a queue. Then, the display unit 108 candisplay, on, for example, the monitor 1110, the information indicating,for example, the time when an object passed the passage detection linesegment and the number of objects in a queue stored in the database 1109stored in the memory 110. Furthermore, the information processingapparatus 100 can acquire, from an external terminal device, informationindicating a time period in which objects information about which is tobe tallied passed the passage detection line segment.

The queuing time measurement system can be configured to calculate aqueuing time with respect to an object entering a queue within apreviously-set period and to display the calculated queuing time on thedisplay device 130. Furthermore, the queuing time measurement system canbe configured to calculate a queuing time with respect to an objectentering a queue each time an object passing through the entrance of thequeue is detected by the entry detection unit 502 and to display thecalculated queuing time on the display device 130. More specifically,each time an object passing through the entrance of a queue is detectedby the entry detection unit 502, the counting unit 103 counts the numberof persons in the queue. Then, the queuing time calculation unit 106calculates a queuing time based on the time when the object got in thequeue and the time when a number of objects corresponding to the numbercalculated by the counting unit 103 have been detected by the exitdetection unit 503.

While, in the third exemplary embodiment, the setting unit 105 sets onlyone region targeted for counting persons with respect to an imagecaptured by one camera, the setting unit 105 can set two or more regionsas illustrated in FIG. 13A.

Furthermore, the setting unit 105 sets one passage detection linesegment in an image. However, as illustrated in FIG. 13B, in a casewhere one camera is placed in such a way as to be able to capture animage of a plurality of reading entrances, the setting unit 105 can seta plurality of passage detection line segments in an image captured bythe camera. In that case, the entry detection unit 502 and the exitdetection unit 503 detect passage of objects at the respective passagedetection line segments.

Furthermore, in a case where the counting unit 103 counts the number ofobjects in the region 913 illustrated in FIG. 9, when the counted numberof objects in the region 913 has become equal to or less than a setthreshold value, the display unit 108 can display the followinginformation on a display monitor 911. Specifically, the display unit 108can display, on the display monitor 911, information prompting a person912 waiting in front of the region 913 in the queue to move to theforward riding entrance.

As described above, according to the processing in the third exemplaryembodiment, even in a case where a plurality of cameras is used todivisionally capture an image of a queue or a case where a plurality ofexits is present in a queue, the queuing time measurement system canmore readily and more stably measure a queuing time.

Furthermore, the queuing time measurement system can calculate anaverage of queuing times of objects exiting a queue in eachpredetermined period, or can determine a queuing time of a certainobject as a representative value in the time period. In that case, if noobject exits the queue in the time period, the queuing time measurementsystem can determine a simple average or weighted average of values ofqueuing times of objects exiting the queue in preceding and subsequenttime periods as a representative value in the time period. Moreover, ifno object exits the queue in the time period, the queuing timemeasurement system can determine any one of values of queuing times ofobjects exiting the queue in preceding and subsequent time periods as arepresentative value in the time period.

In the description of the first to third exemplary embodiments, a queueis formed in a previously set region. In a fourth exemplary embodiment,a case where a queue is formed beyond a set region due to an increase innumber of objects in the queue is described.

A system configuration of the queuing time measurement system and ahardware configuration and functional configuration of each systemconstituent element in the fourth exemplary embodiment are similar tothose in the third exemplary embodiment.

FIGS. 14A, 14B, and 14C illustrate an example of the application of thequeuing time measurement system.

FIG. 14A illustrates an example of a behavior in which a taxi 1401arrives at a taxi stand within a region 1410, in which taxis arrive.

A region 1411 is a region in which persons waiting to take a taxi lineup. Cameras 1408 and 1409 are placed in the region 1411.

The example illustrated in FIG. 14A indicates a state in which any queueis not yet formed, so that no person is present in the region 1411.

FIG. 14B illustrates an example of a state in which a person A who wantsto take a taxi is going to pass through an entrance 1403 to enter theregion 1411.

The queuing time measurement system measures a queuing time of theperson A by performing processing similar to that in the first to thirdexemplary embodiments. For example, the counting unit 103 counts thenumber of persons present in a queue when the person A has entered thequeue based on a still image captured by the camera 1408, and storesinformation indicating a set of the counted number of persons and thetime when the person A has been detected by the entry detection unit 502in, for example, the memory 110.

The queuing time calculation unit 106 determines the time when thenumber of persons detected by the exit detection unit 503 after the timeof detection becomes equal to or greater the stored number of persons asthe time when the person A has exited the queue. The queuing timecalculation unit 106 calculates the actual queuing time of the person Ain the region 1411 by calculating a difference between the time when theperson A has taken a taxi and the time when the person A entering thequeue was detected. The queuing time measurement system also performsthe above-described processing with respect to objects other than theperson A, thus being able to measure a queuing time of each object inthe queue.

FIG. 14C is a diagram illustrating an example of a state in which thequeue has extended beyond the region 1411. FIG. 14C illustrates abehavior in which the queue has extended to a region 1412 adjacent tothe region 1411. At this time, a method of calculating a queuing time bythe queuing time measurement system in a case where a person B entersthe queue is described as follows.

The queuing time measurement system deems a queue formed by objectspresent in the region 1412 to be a first queue, and deems a queue formedby objects present in the region 1411 to be a second queue. Each of thefirst queue and the second queue in the fourth exemplary embodiment isan example of a partial queue.

The entry detection unit 502 detects an object entering the first queuebased on an image of the region 1412 captured by the camera 1409. Forexample, the entry detection unit 502 detects a new object entering theregion 1412 as the object entering the first queue. The entry detectionunit 502 can count the number of objects in the first queue, forexample, in a case where the number of objects remaining still hasincreased according to movement of objects in the region 1412 or a casewhere an object moving has stopped next to an object remaining still.With the above processing, the entry detection unit 502 is able todetect an object entering a queue the entrance of which is notpredetermined.

The exit detection unit 503 detects an object which has moved from theregion 1412 to the region 1411 as an object exiting the first queue andentering the second queue, based on an image of the region 1412 capturedby the camera 1409.

The counting unit 103 counts the number of objects present in the firstqueue when a new object enters the first queue based on an image of theregion 1412 captured by the camera 1409. The counting unit 103 can countthe number of objects present in the first queue when a new objectenters the first queue or can count the number of objects present in thefirst queue periodically at set intervals. The counting unit 103 cancount the number of objects in the first queue, for example, in a casewhere the number of objects remaining still has increased according tomovement of objects in the region 1412 or a case where an object movinghas stopped next to an object remaining still.

When the person B enters the first queue, the queuing time measurementsystem measures a queuing time of the person B in the first queue byperforming processing similar to that in the first to third exemplaryembodiments. Then, when the person B enters the region 1411 from theregion 1412 to get in the second queue, the queuing time measurementsystem measures a queuing time of the person B in the second queue byperforming processing similar to that in the first to third exemplaryembodiments. Then, the queuing time measurement system adds together themeasured queuing time of the person B in the first queue and themeasured queuing time of the person B in the second queue, thusmeasuring a queuing time of the person B in the entire queue.

The queuing time measurement system differentiates between a region theentrance of which is predetermined and a region the entrance of which isnot predetermined and calculates a queuing time in the queue of each ofthe regions, and is, therefore, able to calculate a more accurate actualqueuing time.

The queuing time measurement system can count objects in a region set inan image. Additionally, in a case where an image of a queue is capturedby a plurality of cameras, the queuing time measurement system can beconfigured to sum results of counting of objects in the respectiveimages.

The communication unit 107 or the display unit 108 is able to display,on the display device 130, or transmit, to an external device,information obtained by appropriately tallying and graphing measuredqueuing times in queues as analytical information about queues. Theanalytical information about queues is information useful to, forexample, determine positioning or location of attendants.

As described above, according to the fourth exemplary embodiment, thequeuing time measurement system can measure a queuing time of an objecteven in a case where a queue is formed beyond a region set as a regionin which a queue is to be formed.

The present disclosure is not limited to the first to fourth exemplaryembodiments, and can be modified or varied in various manners within therange of the scope thereof.

One or more functions of the above-described exemplary embodiments canbe implemented by supplying a program to a system or apparatus via anetwork or a storage medium and causing one or more processors in acomputer of the system or apparatus to read out and execute the program.The above-described functions can also be implemented by a circuit thatimplements one or more of the functions, e.g., an application specificintegrated circuit (ASIC).

While various exemplary embodiments have been described above, thesespecific exemplary embodiments are not seen to be limiting.

For example, a part or the whole of the functional configuration of theabove-described queuing time measurement system can be implemented ashardware in the information processing apparatus 100.

Other Embodiments

Embodiment(s) can also be realized by a computer of a system orapparatus that reads out and executes computer executable instructions(e.g., one or more programs) recorded on a storage medium (which mayalso be referred to more fully as a ‘non-transitory computer-readablestorage medium’) to perform the functions of one or more of theabove-described embodiment(s) and/or that includes one or more circuits(e.g., application specific integrated circuit (ASIC)) for performingthe functions of one or more of the above-described embodiment(s), andby a method performed by the computer of the system or apparatus by, forexample, reading out and executing the computer executable instructionsfrom the storage medium to perform the functions of one or more of theabove-described embodiment(s) and/or controlling the one or morecircuits to perform the functions of one or more of the above-describedembodiment(s). The computer may comprise one or more processors (e.g.,central processing unit (CPU), micro processing unit (MPU)) and mayinclude a network of separate computers or separate processors to readout and execute the computer executable instructions. The computerexecutable instructions may be provided to the computer, for example,from a network or the storage medium. The storage medium may include,for example, one or more of a hard disk, a random access memory (RAM), aread-only memory (ROM), a storage of distributed computing systems, anoptical disk (such as a compact disc (CD), digital versatile disc (DVD),or Blu-ray Disc (BD)™), a flash memory device, a memory card, and thelike.

While exemplary embodiments have been described, it is to be understoodthat the invention is not limited to the disclosed exemplaryembodiments. The scope of the following claims is to be accorded thebroadest interpretation so as to encompass all such modifications andequivalent structures and functions.

This application claims the benefit of Japanese Patent Application No.2016-168355 filed Aug. 30, 2016, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. An information processing apparatus comprising: afirst detection unit configured to detect an object entering a queue; asecond detection unit configured to detect an object exiting the queue;an acquisition unit configured to acquire a number of objects lining upin a queue which includes a target object targeted for measuring aqueuing time, in a case where the first detection unit has detected thatthe target object has entered the queue; a measurement unit configuredto measure, as the queuing time of the target object in the queue, aperiod from a time when the target object has entered the queue to atime when a number of objects having been detected by the seconddetection unit has reached the number acquired by the acquisition unit;and an output unit configured to output the queuing time of the targetobject in the queue measured by the measurement unit.
 2. The informationprocessing apparatus according to claim 1, wherein the first detectionunit detects an object passing through an entrance of the queue based ona plurality of images of the queue captured at set intervals, andwherein the second detection unit detects an object passing through anexit of the queue based on a plurality of images of the queue capturedat set intervals.
 3. The information processing apparatus according toclaim 2, wherein the first detection unit detects an object passingthrough the entrance of the queue based on a position of an object ineach of the plurality of images of the queue captured at set intervals,and wherein the second detection unit detects an object passing throughthe exit of the queue based on a position of an object in each of theplurality of images of the queue captured at set intervals.
 4. Theinformation processing apparatus according to claim 3, wherein the firstdetection unit detects an object passing through the entrance of thequeue based on a line segment indicating the entrance of the queue andthe position of an object in each of the plurality of images of thequeue captured at set intervals, and wherein the second detection unitdetects an object passing through the exit of the queue based on a linesegment indicating the exit of the queue and the position of an objectin each of a plurality of images of the queue captured at set intervals.5. The information processing apparatus according to claim 4, whereinthe line segment indicating the exit of the queue in each of theplurality of images of the queue captured at set intervals is a linesegment set in such a manner that a size of each of regions on bothsides across the line segment in each image is greater than or equal toa set size, and wherein the line segment indicating the entrance of thequeue in each of the plurality of images of the queue captured at setintervals is a line segment set in such a manner that a size of each ofregions on both sides across the line segment in each image is greaterthan or equal to a set size.
 6. The information processing apparatusaccording to claim 4, further comprising a reception unit configured toreceive a designation of the line segment indicating the entrance or theexit of the queue via a line segment designation screen including acaptured image of the queue and used to designate the line segmentindicating the entrance or the exit of the queue, wherein the firstdetection unit detects an object passing through the entrance of thequeue based on the line segment indicating the entrance of the queueindicated by the designation received by the reception unit and theposition of an object in each of a plurality of images of the queuecaptured at set intervals, and wherein the second detection unit detectsan object passing through the exit of the queue based on the linesegment indicating the exit of the queue indicated by the designationreceived by the reception unit and the position of an object in each ofa plurality of images of the queue captured at set intervals.
 7. Theinformation processing apparatus according to claim 2, wherein thesecond detection unit detects an object passing through the exit of thequeue based on a plurality of line segments indicating a plurality ofexits of the queue and a position of an object in each of a plurality ofimages of the queue captured at set intervals.
 8. The informationprocessing apparatus according to claim 1, wherein, in a case where thetarget object enters the queue including a plurality of partial queuesserving as a plurality of queues, with respect to each of the pluralityof partial queues, the acquisition unit acquires a number of objectslining up in a partial queue which includes the target object, in a casewhere the first detection unit has detected that the target object hasentered the partial queue, wherein, with respect to each of theplurality of partial queues, the second detection unit detects an objectexiting the partial queue, and wherein the measurement unit measures aqueuing time of the object in the queue by acquiring, with respect toeach of the plurality of partial queues, a period from a time when thetarget object has entered the partial queue to a time when a number ofobjects having been detected by the second detection unit has reachedthe number acquired by the acquisition unit with respect to the partialqueue and summing the acquired periods.
 9. The information processingapparatus according to claim 1, wherein the acquisition unit acquiresthe number of objects lining up in the queue based on a number ofobjects that have entered the queue and a number of objects that haveexited the queue.
 10. The information processing apparatus according toclaim 1, wherein the acquisition unit acquires the number of objectslining up in the queue by detecting an object from a captured image ofthe queue and counting a number of detected objects.
 11. The informationprocessing apparatus according to claim 10, wherein the acquisition unitacquires the number of objects lining up in the queue by detecting anobject from a region targeted for counting objects set in a capturedimage of the queue and counting a number of detected objects.
 12. Theinformation processing apparatus according to claim 11, furthercomprising a reception unit configured to receive a designation of theregion targeted for counting objects via a region designation screenincluding a captured image of the queue and used to designate the regiontargeted for counting objects, wherein the acquisition unit acquires thenumber of objects lining up in the queue by detecting an object from theregion targeted for counting objects in a captured image of the queueindicated by the designation received by the reception unit and countinga number of detected objects.
 13. The information processing apparatusaccording to claim 10, wherein, by detecting an object from an image ofthe queue captured at a set time and counting a number of detectedobjects, the acquisition unit acquires a number of objects lining up inthe queue at the set time, and acquires a number of objects lining up inthe queue at time after the set time based on the number of objectslining up in the queue at the set time, a number of objects that haveentered the queue after the set time, and a number of objects that haveexited the queue after the set time.
 14. The information processingapparatus according to claim 10, wherein the acquisition unit acquiresthe number of objects lining up in the queue by detecting an object fromeach of a plurality of images of the queue separately captured at anidentical time, counting objects detected in each of the plurality ofimages, and summing together a result of counting the objects.
 15. Theinformation processing apparatus according to claim 10, wherein theacquisition unit acquires the number of objects lining up in the queueby detecting a set portion of an object from a captured image of thequeue to detect an object and counting a number of detected objects. 16.The information processing apparatus according to claim 1, furthercomprising a comparison unit configured to compare the queuing time ofthe target object in the queue measured by the measurement unit with apredicted value of a set queuing time, wherein the output unit outputs acomparison result.
 17. An information processing method, the informationprocessing method comprising: a first detection step for detecting anobject entering a queue; a second detection step for detecting an objectexiting the queue; an acquiring step for acquiring a number of objectslining up in a queue which includes a target object targeted formeasuring a queuing time, in a case where the target object entering thequeue has been detected in the first detection step; a measuring stepfor measuring, as the queuing time of the target object in the queue, aperiod from a time when the target object has entered the queue to atime when a number of objects having been detected in the seconddetection step has reached the number acquired in the acquiring step;and an output step for outputting the queuing time of the target objectin the queue measured in the measurement step.
 18. A non-transitorycomputer-readable storage medium storing computer-executableinstructions that when executed by a computer cause the computer toperform a method, the method comprising: a first detection step fordetecting an object entering a queue; a second detection step fordetecting an object exiting the queue; an acquiring step for acquiring anumber of objects lining up in a queue which includes a target objecttargeted for measuring a queuing time, in a case where the target objectentering the queue has been detected in the first detection step; ameasuring step for measuring, as the queuing time of the target objectin the queue, a period from a time when the target object has enteredthe queue to a time when a number of objects having been detected in thesecond detection step has reached the number acquired in the acquiringstep; and an output step for outputting the queuing time of the targetobject in the queue measured in the measurement step.